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Abstract 


This  report  presents  a  review  of  trends  and  issues  in  user  satisfaction  with 
customer  service  in  Western  Europe  in  1990.  The  report  summarises  data 
previously  published  by  INPUT  in  three  reports  titled  User  Satisfaction 
with  Vendor  Customer  Services  in  Western  Europe,  1990.  Each  report 
refers  to  either  the  large,  medium  or  small  systems  sector  of  the  market. 

The  data  presented  in  this  report  was  collected  by  INPUT  during  1990  in 
a  survey  of  computer  users  in  the  following  countries: 

•  Belgium 

•  France 

•  Germany 

•  Italy 

•  The  Netherlands 

•  Norway 

•  Spain 

•  Sweden 

•  The  United  Kingdom 

The  report  identifies  trends  in  user  perception  between  1989  and  1990  for 
defined  aspects  of  customer  service.  Thus  the  data  allows  comparison  of 
changing  user  needs  with  actual  service  performance. 

In  addition,  the  report  analyses  the  results  of  in-depth  interviews,  con- 
ducted with  computer  users,  aimed  at  identifying  key  user  issues  relating 
to  the  perceived  level  of  service  provided  by  vendors. 

This  report  contains  166  pages  including  136  exhibits. 
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I 

Introduction 


A  

Objectives  and  Scope    This  report  provides  data  relating  to  trends  in  user  satisfaction  with 

vendor  customer  services  in  Western  Europe. 

The  report  has  three  objectives: 

•  To  provide  data  indicating  trends  in  user  satisfaction  with  customer 
services  that  have  occurred  between  1989  and  1990.  The  report  also 
presents  data  relating  user  percepdon  of  vendor  response  and  repair/fix 
time  performance  and  system  failure  rates  between  1988  and  1990. 

•  To  provide  analysis  and  identificadon  of  key  user  issues  with  vendor 
customer  services 

•  To  provide  data  relating  to  the  comparative  performance  of  twelve 
vendors'  customer  services  organisadons. 

In  order  to  take  full  advantage  of  some  aspects  of  the  data,  the  analysis 
has  been  concentrated  primarily  on  companies  and  secondarily  on  coun- 
tries. 

B  

Mediodology  The  data  presented  in  this  report  was  compiled  from  interviews  with 

computer  users  throughout  Western  Europe.  Users  were  chosen  at 
random  and  interviewed  by  telephone  in  their  native  languages.  The 
basis  of  the  interview  was  a  quesdonnaire  relating  to  some  150  aspects  of 
service  and  support,  compiled  in  discussion  with  major  service  vendors. 
A  copy  of  the  1990  user  quesdonnaire  is  included  as  Appendix  A. 

Details  of  user  samples  that  relate  to  the  data  presented  in  this  report  are 
as  follows: 
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•  Interviews  with  1,211  computer  users  during  1990 

•  Interviews  with  1,626  computer  users  in  1989 

•  Interviews  with  1,593  computer  users  in  1988 

A  breakdown  of  the  1990  user  interview  sample  is  provided  in  Exhibits 
I-l  and  1-2. 

Data  presenting  the  key  user  issues  with  vendor  customer  services  in 
1990  was  compiled  from  30  additional  in-depth  user  interviews,  which 
were  conducted  either  face-to-face  or  by  telephone.  A  copy  of  the 
questionnaire  used  for  in-depth  interviews  is  included  as  Appendix  B. 


User  Sample  by  Vendor 


Vendor 

System  Range 

Large 

Medium 

Small 

Total 

Amdahl 

105 

- 

- 

105 

Bull 

7 

38 

37 

82 

Digital 

31 

31 

29 

91 

Hewlett-Packard 

71 

10 

81 

IBM 

66 

148 

43 

257 

ICL 

45 

107 

46 

198 

NCR 

7 

29 

36 

Philips 

63 

16 

79 

Siemens 

5 

17 

3 

25 

Stratus 

40 

40 

Unisys 

18 

42 

17 

77 

Wang 

21 

28 

33 

82 

Other  Vendors 

19 

24 

15 

58 

Total 

324 

638 

249 

1,211 
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User  Sample  by  Country 


System  Range 

Vendor 

Large 

Medium 

Small 

Total 

Belgium 

15 

23 

8 

46 

France 

34 

94 

55 

183 

Germany 

39 

93 

22 

154 

Italy 

44 

50 

24 

118 

Netherlands 

16 

54 

17 

87 

Norway 

7 

10 

7 

24 

Spain 

22 

52 

16 

90 

Sweden 

13 

51 

18 

82 

United  Kingdom 

102 

164 

70 

336 

Other  European 
Countries 

32 

47 

12 

91 

Total 

324 

638 

249 

1,211 

c  

Report  Structure  •  Chapter  n  explains  the  interpretation  of  the  data  presented  in  the  report. 

•  Chapter  EI  is  an  Executive  Overview  of  the  key  trends  in  Western 
Europe  and  presents  the  data  in  condensed  form. 

•  Chapter  FV  contains  analysis  of  the  in-depth  user  interviews  and  identi- 
fies the  key  issues  that  emerged  from  them. 

•  Chapter  V  presents  analysis  of  vendor  hardware  service  and  systems 
software  support  performance  trends  in  Western  Europe  overall. 

•  Chapter  VI  contains  analysis  relating  to  the  hardware  service  and 
systems  software  support  performance  trends  of  12  individual  vendors 
segmented  by  system  size. 
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•  Chapter  VII  presents  data  that  compares  the  user  satisfaction  achieve- 
ments of  12  individual  vendors  and  the  level  of  user  satisfaction 
achieved  in  four  key  country  markets  in  1990. 

•  Appendix  A  contains  the  1990  user  questionnaire  used  for  general 
telephone  interviews. 

•  Appendix  B  contains  the  user  questionnaire  used  for  in-depth  user 
interviews. 


•  Customer  Services  in  Western  Europe,  1989  (Annual  Report) 

•  Customer  Services  in  Western  Europe,  1988  (Annual  Report) 

The  base  data  used  for  presentation  of  1990  vendor  service  performance 
achievements  was  from: 

•  User  Satisfaction  with  Vendor  Customer  Services,  Final  Results  1990. 
This  report  was  pubUshed  in  three  volumes:  Large  Systems,  Medium 
Systems  and  Small  Systems. 


D 


Related  INPUT 


Data  from  the  following  reports  was  also  used: 


Reports 
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Interpretation  of  the  Data 


A  

Definitions  •  Hardware:  any  computer  system  or  peripheral  system. 

•  Software:  operating  systems  software,  NOT  applications. 

•  Large  system:  a  system  that  the  vendor  considers  part  of  that  vendor's 
large  system  product  range — -for  example,  IBM  309X  and  308X,  Bull 
DPS  8,  or  Digital  VAX  8XXX. 

•  Medium  system:  a  system  that  is  considered  by  the  vendor  as  part  of 
that  vendor's  medium  systems  product  range — for  example,  IBM 
43XX,  S/38,  Bull  DPS7,  or  Digital  VAX  6XXX. 


B 


Small  system:  a  system  that  is  considered  by  the  vendor  as  part  of  that 
vendor's  small  system  product  range — for  example,  IBM  S/36  and  8/ 
34,  Bull  DPS  6,  or  Digital  Micro  VAX. 


Ratings  and  Except  where  otherwise  stated,  ratings  for  importance  and  satisfaction  are 

Satisfaction  Index        on  a  scale  of  0  to  10,  where: 


•  Importance 

-  0  =  of  no  importance  whatsoever 

-  5  =  of  average  importance 

-  10  =  extremely  important 

•  Satisfaction 

-  0  =  total  and  absolute  dissatisfaction 

-  5  =  average  satisfaction 

-  10  =  total  satisfaction 
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The  satisfaction  index  used  throughout  this  report  is  based  on  the  differ- 
ence between  the  importance  and  satisfaction  ratings  for  specific  aspects 
of  service.  The  questions  concerning  importance  and  satisfaction  were 
asked  at  the  same  time  and  the  answers  therefore  reflect  the  respondents' 
value  judgement  at  that  time. 

•  Figures  of  10  and  10  or  6  and  6  etc.,  give  a  difference  value  of  zero, 
indicating  that  the  importance  needs  are  completely  satisfied. 

®  Figures  of  importance  8  and  satisfaction  9  would  indicate 
overfulfillment  of  the  importance  needs  and  would  give  a  satisfaction 
index  of  -1.  In  INPUT'S  analysis,  an  overfulfilment  of  -1  is  repre- 
sented as  (1). 

•  Figures  of  importance  6  and  satisfaction  5  indicate  underfulfillment  of 
the  importance  needs,  the  degree  of  underfulfillment  being  related  to 
the  magnitude  of  this  difference. 

•  Satisfaction  index  can  thus  be  interpreted  as  follows: 


-  (1)  =  overfulfilled  or  oversatisfled 

-  0  =  completely  satisfied 

-  1  =  concerns  and  worries 

-  2-  real  dissatisfaction 

-  3  =  pain  level 
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Executive  Overview  of 
Western  Europe 


A 

User  satisfaction  with  the  performance  of  vendor  customer  services 
organisations  has  improved  compared  to  the  previous  year,  which  sug- 
gests that  efforts  made  by  vendors  in  this  area  are  now  beginning  to  be 
appreciated  by  users. 

Since  1987,  user  satisfaction  with  customer  services  has  been  on  a  pro- 
gressive and  relatively  significant  decline.  However,  the  results  of 
input's  latest  survey  of  over  1,200  computer  users  throughout  Westem 
Europe  highlights  two  important  changes: 

•  Overall  user  satisfaction  with  hardware  service  and  systems  software 
support  shows  marginal  improvements  over  results  obtained  in  1989. 

•  More  importantly,  the  trend  of  declining  user  satisfaction  has  been 
arrested  and  promises  to  reverse  if  current  trends  continue. 

Although  results  indicate  that  much  progress  has  been  made,  specific 
areas  of  service  continue  to  be  of  concern  to  users: 

•  Even  though  the  progressive  decline  of  user  satisfaction  with  systems 
software  support  has  been  checked,  user  satisfaction  nevertheless 
remains  at  a  level  that  indicates  a  degree  of  concerns  and  worries. 

•  Systems  software  support  response  and  fix  time  performance  continues 
to  indicate  a  more  than  20%  shortfall  against  user  expectations. 

•  Service  and  support  documentation  remains  a  key  user  issue  and  is  the 
cause  of  a  relatively  high  degree  of  user  dissatisfaction. 

•  User  satisfaction  with  vendor  customer  service  remains  a  subject  of 
concern  and  worry  in  some  individual  country  markets. 


Vendor  Efforts  Are 
Rewarded  by 
Improvements  in  User 
Satisfaction  with 
Service 
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-  Four  country  markets  indicate  a  degree  of  user  concerns  and  worries 
related  to  hardware  service,  and  six  country  markets  relative  to 
systems  software  support. 

Continued  efforts  and  pressure  by  customer  services  vendors  are  a 
primary  requirement  to  ensure  that  current  trends  are  maintained.  Ven- 
dors are  therefore  urged  to  apply  all  efforts  to  achieving  further  improve- 
ment in  user  satisfaction  as  a  primary  organisational  goal. 

Exhibit  ni-1  identifies  the  major  trends  that  emerge  from  INPUT'S  1990 
survey  of  computer  users  in  Western  Europe. 


Key  Trends  in  User  Satisfaction 

1990 

•  User  satisfaction  improves 

-  Hardware  service 

-  Systems  software  support 

•  System  failure  rates  improve 

•  Specific  elements  remain  critical 

In  overall  terms,  all  trend  indicators  measured  indicate  that  a  positive 
improvement  in  user  perception  of  vendor  service  has  been  achieved  in 
1990.  Trend  indicators  that  measure  this  improvement  in  user  perception 
are: 

•  Satisfaction  with  hardware  service 

•  Satisfaction  with  systems  software  support 

•  Satisfaction  with  systems  availability 

•  System  failure  rates 

•  Hardware  service  response  and  repair  times 

•  Systems  software  support  response  and  fix  times 

Not  all  items  listed  show  positive  improvement,  but  overall  level  of  user 
satisfaction  with  service  performance  has  improved  as  a  consequence  of 
improvement  in  some  aspects  and  consistency  in  others. 
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As  a  result  of  1990  vendor  performance  achievements,  a  previous  decline 
in  user  satisfaction  with  vendor  service  has  been  arrested  and  is  showing 
signs  of  reversal. 


Major  Issues 
and  Trends 


Although  a  significant  improvement  in  user  satisfaction  with  vendor 
service  has  been  achieved,  some  major  issues  remain.  These  issues,  most 
of  which  are  long-standing,  are  listed  in  Exhibit  111-2. 

The  issues  listed  in  Exhibit  111-2  are  not  universal  to  all  system  size 
market  sectors.  For  example,  apart  from  systems  software  support 
engineer  skills,  large  system  users  seem  relatively  satisfied  with  the  level 
of  vendor  service  provided«  However,  there  are  some  signs  that  user 
satisfaction  in  the  medium  and  small  systems  sectors  is  becoming  more 
critical.  Although  at  present  these  trends  are  relatively  insignificant,  it  is 
nonetheless  important  to  be  aware  that  they  exist.  For  example,  in  the 
medium  systems  sector,  user  satisfaction  with  system  software  support  is 
rated  at  the  concern  level  (satisfaction  index  >1.0)  in  four  aspects  of 
service: 


EXHIBIT  III-2 


Key  User  Issues 

•  Availability  of  spare  parts 

•  Engineer  skills 

•  Documentation 

•  Provision  of  software  updates 

•  Engineer  skills 

•  Documentation 

•  Provision  of  updates 

•  Remote  diagnostics 

In  the  small  systems  sector,  user  satisfaction  is  rated  at  the  concern  level 
in  three  aspects  of  systems  software  support: 

•  Engineer  skills 

•  Documentation 

•  Provision  of  updates 
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The  major  ongoing  user  issue  is  satisfaction  with  support  documentation, 
which  is  now  mainly  concentrated  on  system  software  support  documen- 
tation in  the  medium  and  small  systems  sectors. 


Service  Trends 


1.  Hardware  Service  Satisfaction 


Exhibit  ni-3  illustrates  overall  trends  in  user  satisfaction  with  hardware 
service  over  the  four-year  period  from  1987  to  1990. 


EXHIBIT  111-3 


Western  Europe 
Hardware  Service  Satisfaction  Trends 
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Two  important  characteristics,  highlighted  by  Exhibit  ni-3,  are: 

•  The  progressive  and  relatively  significant  decline  in  user  satisfaction 
with  hardware  service  between  1987  and  1989,  at  which  time  the  level 
of  satisfaction  almost  reached  the  concern  level  where  (satisfaction 
index  =  1.0). 

•  A  reversal  of  the  trend  in  user  satisfaction  between  1989  and  1990. 
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However,  the  trend  data  illustrated  is  an  overall  average  and  within  this 
average,  pockets  of  user  concern  remain.  For  example,  users  of  medium- 
sized  computer  systems  in  Germany  rate  all  five  aspects  of  hardware 
service  at  the  concern  level. 

Computer  user  satisfaction  with  hardware  service  in  Germany  is  rela- 
tively poor  and  vendors  are  recommended  to  investigate  this  phenomenon 
more  closely. 

When  assessing  this  data,  readers  are  advised  that  in  1990,  five  aspects  of 
hardware  service  were  surveyed,  compared  with  twelve  aspects  in  1989 
and  previous  years.  The  comparisons  are  still  valid;  the  five  aspects  of 
hardware  service  focused  on  in  1990  were  chosen  as  the  most  critical 
areas: 

•  Spares  availability 

•  Engineer  skills 

•  Problem  escalation 

•  Documentation 

•  Remote  diagnostics 

2.  Systems  Software  Support  Satisfaction 

Exhibit  ni-4  illustrates  the  overall  trends  in  user  satisfaction  with  systems 
software  support  over  the  four- year  period  1987  to  1990. 

Data  contained  in  Exhibit  111-4  indicates  a  similar  trend  to  that  in  hard- 
ware service: 

•  A  relatively  significant  decHne  in  user  satisfaction  between  1987  and 
1989 

•  A  reversal  of  this  decline  between  1989  and  1990 

There  is  one  important  difference,  however.  User  satisfaction  with 
systems  software  support  is  sdll  rated  overall  at  the  concern  level 
(satisfaction  index  =  1 .0). 

As  with  hardware  service,  user  satisfaction  with  systems  software  support 
in  Germany  is  relatively  poor. 

Due  to  the  overall  concern  ratings  given  by  users  to  systems  software 
support,  vendors  are  recommended  to  make  urgent  efforts  to  maintain  the 
positive  trend  found  in  the  1990  survey. 
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Western  Europe 
Systems  Software  Support  Satisfaction  Trends 


Year:    1987      1988      1989  1990 


Sample  Size:    1,321      1,593     1,626  1,211 


When  assessing  this  data,  readers  are  advised  that  in  1990,  five  aspects  of 
systems  software  support  were  surveyed,  compared  with  thirteen  aspects 
in  1989  and  previous  years.  The  comparisons  are  still  valid.  The  five 
aspects  of  system  software  support  focused  on  were  chosen  as  the  more 
critical  areas: 

•  Engineer  skills 

•  Documentation 

•  Software  installation 

•  Provision  of  updates 

•  Remote  diagnostics 

3.  Systems  Availability 

Exhibit  ni-5  illustrates  the  trends  in  user  importance  ratings  for  systems 
availability  and  the  level  of  user  satisfaction  achieved  over  the  four-year 
period  from  1987  to  1990. 

The  data  contained  in  Exhibit  111-5  illustrates  the  following  characteris- 
tics: 
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Western  Europe 
System  Availability  Trends 
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Users  place  a  consistently  high  level  of  importance  on  systems  avail- 
ability. Systems  availability  is,  overall,  the  most  important  aspect  of 
computer  operations  and  therefore  attracts  the  highest  importance 
ratings. 


•  User  satisfaction  with  systems  availability  was  also  relatively  constant 
between  1987  and  1990,  and  except  for  1988,  the  overall  level  of  user 
satisfaction  with  system  availability  has  remained  slightly  below  the 
concern  level  (A  SI  =  1.0). 

Even  in  Germany,  where  user  satisfaction  with  service  is  generally  low, 
satisfaction  with  system  availability  is  below  the  concern  level,  with  one 
exception.  That  exception  is  in  the  medium-systems  sector  where  satis- 
faction is  rated  at  the  concern  level. 
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4.  System  Failure  Rates 

Exhibit  in-6  illustrates  user-perceived  trends  in  system  failure  rates  over 
the  four-year  period  between  1987  and  1990. 

The  trend  data  contained  in  Exhibit  III-6  indicates  that  following  a  three- 
year  period  between  1987  and  1989  during  which  the  user-perceived 
numbers  of  system  failures  increased,  this  trend  has  now  been  reversed. 
The  degree  of  this  trend  reversal  is  significant  in  that  the  user-perceived 
level  of  system  failures  reduced  by  over  25%  between  1989  and  1990. 


EXHIBIT  III-6 
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5.  Hardware  Service  Response  and  Repair  Times 

Exhibit  ni-7  illustrates  trends  in  user  perception  of  vendor  hardware 
response  and  repair  time  performance  over  the  four-year  period  from 
1987  to  1990. 
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Over  the  four-year  period  illustrated,  vendor  response  and  repair  time 
performance  has  remained  relatively  constant.  However,  one  key  factor 
illustrated  by  the  trend  data  in  Exhibit  ni-7  is  that  vendor  performance, 
overall,  consistently  falls  below  user  expectation  levels.  While  a  small 
shortfall  is  not  an  unacceptable  situation,  ideally  this  shortfall  should  be 
kept  below  10%. 


Western  Europe 
Hardware  Service  Response/Repair  Time  Trends 
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Response  time  and  vendor  responsiveness  are  the  more  important  of  the 
two  factors  (response  and  repair)  illustrated  by  Exhibit  III-7.  It  is  pos- 
sible that  by  improving  response  time  performance,  repair  time  decreases 
in  significance,  within  reasonable  hmits. 
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6.  Systems  Software  Response  and  Fix  Times 

Exhibit  in-8  illustrates  trends  in  user  perception  of  vendor  systems 
software  response  and  fix  time  performance  over  the  four-year  period 
from  1987  to  1990. 

In  overall  terms,  a  significant  improvement  in  vendor  performance  is 
indicated  between  1987  and  1990.  One  major  problem,  however,  is  that 
both  response  and  repair  time  performance  fall  short  of  user  expectation 
levels  by  a  significant  margin. 


As  in  the  case  of  hardware  service,  response  time  performance  is  likely 
to  be  the  most  critical  factor  and  the  shortfall  against  user  expectation  is 
almost  30%.  Vendors  are  therefore  urged  to  make  all  efforts  to  improve 
perceived  response  time  performance. 


EXHIBIT  III-8 
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D  

Vendor  Quality  During  the  course  of  user  interviews,  INPUT  requested  that  users  provide 

Image  Ratings  answers  to  the  following  questions: 

•  How  important  is  hardware  maintenance,  or  systems  software  support, 
to  your  business  and  how  satisfied  are  you  with  it?  Answers  to  this 
question  tend  to  be  reflexive  or  reactive. 

•  Users  are  requested  to  provide  importance  and  satisfaction  ratings  for 
five  aspects  of  hardware  service  and  five  aspects  of  systems  software 
support.  Answers  to  these  questions  tend  to  be  more  considered  or 
weighted  responses. 

A  June  1989  INPUT  report,  Quality  Issues,  Western  European  Customer 
Services,  contained  analysis  of  the  connection  between  reflex  response 
and  measurable  service  performance.  This  analysis  concluded  that  the 
reflex  response  was  a  measure  of  vendors'  service  quality  image. 

Exhibits  III-9  to  HI- 14  provide  a  comparison  between  the  considered  (or 
weighted)  responses  and  vendors'  service  quality  image  (reflex  re- 
sponses). In  these  exhibits,  vendors  are  listed  in  order  of  overall  user 
satisfaction  with  service. 

•  Overall  user  satisfaction  ratings  are  expressed  as  the  mean  value  of  the 
satisfaction  ratings  for  either  the  five  individual  aspects  of  hardware 
service  or  the  five  individual  aspects  of  systems  software  support. 

•  Vendor  quality  image  rating  is  related  to  these  individual  aspects  of 
service  but  also  includes  additional  service  performance  factors  such  as: 

-  satisfaction  with  system  availability 

-  system  failure  rates 

-  vendor  response  time 

-  vendor  repair/fix  time 

The  most  significant  factor  that  emerges  from  the  data  in  Exhibits  III-9  to 
in- 14  is  satisfaction  with  systems  software  support.  Although  the  system 
size  segments  were  not  separated  in  1989,  only  two  vendors  achieved  a 
better  than  concern  level  rating  for  the  weighted  response,  whereas  in 
1990,  four  vendors  achieved  this  overall  level  of  performance.  This  trend 
further  supports  the  overall  improvement  in  user  satisfaction  that  has 
occurred  between  1989  and  1990. 
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EXHIBIT  111-9 


Vendor 


Amdahi 

ICL 

IBM 

*  Bull 
Digital 

*NCR 

*  Unisys 

*  Siemens 
Wang 


Western  Europe 
Vendor  Service  Quality  Image 
Large  Systems— Hardware  Service 

Satisfaction  Index  A  SI 


Weighted  Response       I         Quality  image 
2.0  1.0  0.0  1.0  2 


T 


0.1 


0.5 
0.6 
0.7 
0.9 


7 


T 


0.° 


1 


0.3 


A 


0.8 


A 


1.7 


1.3 


Note:  *  indicates  small  sample 
Total  sample  size:  324 


18 


1991  by  INPUT.  Reproduction  Prohibited. 


CEISF 


USER  SATISFACTION— TRENDS  AND  ISSUES.  1990  INPUT 


EXHIBIT  111-10 


Western  Europe 
Vendor  Service  Quality  Image 
Large  Systems — Systems  Software  Support 


Satisfaction  Index  A  Si 


Note:  *  indicates  small  sample 


Total  sample  size:  324 
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Vendor 


Hewiett- 
Packard 

Digital 
IBM 


Western  Europe 
Vendor  Service  Quality  Image 
Medium  Systems— Hardware  Service 


Satisfaction  Index  A  SI 


Weighted  Response 
2.0  1.0 


Quality  Image  Rating 
1.0  2.0 


0.8 


y///////A^-^ 


y///////A^-2 


y//////////A 


1.5 


Note:  *  indicates  small  sample 
Total  sample  size:  638 
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EXHIBIT  111-12 


Western  Europe 
Vendor  Service  Quality  Image 
Medium  Systems — Systems  Software  Support 


Vendor 


Digital 

Hewlett- 
Packard 

Stratus 
ICL 

Philips 

*Siemens 

IBM 

NCR 

Unisys 

Bull 

Wang 


Satisfaction  Index  A  SI 


Weighted  Response 

2.0  1.0 


T 


Quality  Image  Rating 

1.0  2,0 


2.0 


T 


1.1 

1.1 


1.2 


y///////A  1 .2 


V////////A 


Note:  *  indicates  small  sample 
Total  sample  size:  638 


2.2 
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EXHIBIT  111-13 


Western  Europe 
Vendor  Service  Quality  Image 
Small  Systems — Hardware  Service 


Satisfaction  Index  A  SI 


Note:  *  indicates  small  sample 


Total  sample  size:  249 
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EXHIBIT  111-14 


Western  Europe 
Vendor  Service  Quality  Image 
Small  Systems — Systems  Software  Support 


Satisfaction  Index  A  SI 


Note:  *  indicates  small  sample 


Total  sample  size:  249 
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Key  User  Issues  with  Customer 
Service  in  Western  Europe 


This  chapter  highlights  the  findings  from  a  series  of  detailed  follow-on 
interviews  with  thirty  customer  service  users  designed  to  provide  insight 
into  the  overall  findings  of  the  survey.  Twenty-eight  such  interviews 
were  conducted,  the  principal  findings  of  which  are  detailed  in  this 
chapter. 


Hardware  Service         Only  53%  of  the  sample  expressed  a  general  level  of  satisfaction  with  the 

hardware  service  they  have  received  without  feeling  the  need  to  voice 
some  level  of  criticism.  There  are  indications,  therefore,  that  there  are  a 
number  of  points  of  concern  that  are  widely  felt  among  the  user  commu- 
nity. Exhibit  IV- 1  provides  a  breakdown  of  the  overall  levels  of  satisfac- 
tion expressed  about  the  principal  constituents  of  the  hardware  service 
product. 

These  ratings  can  be  compared  to  the  percentage  of  respondents  who 
expressed  dissatisfaction  with  particular  elements  of  hardware  service  as 
illustrated  in  Exhibit  rV-2.  From  this  comparison  a  number  of  issues 
emerge: 

•  Although  there  is  an  apparently  healthy  majority  of  respondents  who 
are  satisfied  with  the  skill  levels  of  engineers,  this  disguises  the  fact  that 
there  is  a  significant  minority  who  are  not,  which  at  over  25%  of  the 
whole  gives  cause  for  concern.  Examples  of  the  issues  with  which 
users  are  unhappy  include  the  opinion  that  engineers  are  over- 
specialised  and  do  not  have  sufficient  knowledge  of  the  complete 
systems  environment.  A  second  point  that  attracted  comment  was  that 
competent  engineers  tended  to  be  the  exception  rather  than  the  rule. 
Exhibit  rV-4  includes  a  hst  of  the  comments  made  by  respondents  on 
the  subject  of  engineer  skills. 
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EXHIBIT  IV-1 


Percent  of  Respondents  Expressing  Satisfaction  with  the 
Constituent  Element  of  Hardware  Service 

Hardware  Service 
Products 


Spares  Availability 
Engineer  Skills 

Problem  Escalation 
Documentation 

Remote  Diagnostics 


Percent  Satisfied 

Sample  Size:  30 
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EXHIBIT  IV-2 


Major  Areas  of  Concern 
Hardware  Service 


Areas  of  Concern 


100 


Percent  Dissatisfied 


Sample  Size:  30 


•  Delays  in  the  shipment  of  spares  constitutes  the  largest  single  source  of 
dissatisfaction  expressed  about  the  spares  operation.  Examples  of  the 
causes  of  dissatisfaction  include  delays  of  up  to  three  months  in  the 
shipment  of  replacement  print  heads,  and  one  individual  claimed 
regular  delays  of  two  to  three  weeks  in  the  shipment  of  a  wide  range  of 
spares.  There  are  also  indicadons  that  users  detected  delays  in  replac- 
ing failed  components  of  obsolete  equipment.  The  overall  figure  of 
35%  of  the  sample  expressing  dissatisfaction,  coupled  with  the  types  of 
comments  made  (see  Exhibit  rV-4)  indicates  that  this  particular  aspect 
of  service  continues  to  cause  problems. 

•  As  can  be  seen  from  the  fact  that  less  than  half  of  the  sample  expressed 
satisfaction  with  documentation,  this  aspect  of  hardware  service  is  a 
cause  for  concern.  In  addition  to  the  23%  who  claim  that  documenta- 
tion is  excessively  bulky  and  difficult  to  comprehend,  a  further  16% 
make  adverse  comments  with  respect  to  quality. 
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The  specific  areas  of  concern  highlighted  by  respondents  indicates  that 
the  quality  of  service  provided  is  not  fully  meeting  expectations.  This 
finding  is  consistent  with  the  satisfaction  index  for  hardware  service, 
derived  from  the  total  sample,  which  is  summarised  in  Exhibit  rV-3. 

An  overall  average  rating  of  0.7,  while  remaining  within  the  range 
classified  as  satisfied,  does  indicate  the  potential  existence  of  pockets  of 
concern,  supported  by  specific  ratings  of  concem  within  the  medium  and 
small  systems  categories.  The  areas  of  concem  expressed  by  respon- 
dents to  the  in-depth  user  interviews  complement  the  overall  findings  of 
the  survey  and  provides  a  degree  of  insight  into  the  factors  contributing 
to  the  areas  of  satisfaction  that  exist 


Satisfaction  Index  for  Hardware  Service 


Service  Category 

Satisfaction  Index  A  SI 

Large 
Systems 

Medium 
Systems 

Small 
Systems 

Average 

Spares  Availability 

0.8 

1.0 

0.8 

0.9 

Engineer  Skills 

0.6 

0.8 

0.7 

0.7 

Problem  Escalation 

0.6 

0.7 

0.9 

0.7 

Documentation 

0.2 

1.0 

1.0 

0.7 

Remote  Diagnostics 

0.1 

0.8 

0.4 

0.4 

Weighted  Rating 

0.4 

0.8 

0.8 

0.7 

Sample  Size:  1,211 
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EXHIBIT  IV-4 


Selected  Comments  from  Respondents 
Hardware  Service 

General 

•  Does  very  well— difficult  to  fault 

•  Provider  good  in  terms  of  response  and  fix  times 

•  No  complaints.  Remote  diagnostics — excellent  service 

•  Hardware  service  a  problem.  Parts  take  a  long  time  to  turn  up  and 
they  are  often  the  wrong  ones  when  they  arrive 

•  Aged  machine.  Availability  of  parts  is  a  problem.  Attitude  of 
provider  becoming  slacker 

•  Repair  times  are  too  long.  Service  is  expensive  and  quality  of 
replacement  parts  a  problem 

Spares  Availability 

•  Not  bad — spares  a  problem.  Provider  will  often  take  a  peripheral 
away  for  up  to  a  week 

•  Peripheral  spares  can  be  difficult — 3  month  delay  on  print  heads 

•  We  need  spares  on  site  but  the  vendor  refuses.  We  can  therefore 
wait  2-3  weeks  for  parts 
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EXHIBIT  IV-4  (Com.) 


Selected  Comments  from  Respondents 
Hardware  Service 


•  Engineer  Skills 

-  Engineer  knowledge  very  good  but  lacks  understanding  of  complete 
environment 

-Variable—good  engineers  are  overspecialized  and  there  is  no  single 
point  of  contact 

-Allocated  engineer  excellent;  but  overall  level  of  skills  is 
unsatisfactory 

•  Problem  Escalation 

-Problem  escalation  could  be  improved.  The  user  was  not  kept 
informed  of  status 

-  Problem  escalation  theoretically  good  but,  in  practice,  it  doesn't 
meet  the  requirement 

-  Problem  escalation  poor.  There  is  a  lack  of  account  management 

-  Problem  escalation  poor.  System  of  call  handling  is  excessively 
bureaucratic 
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EXHIBIT  IV-4  (Com.) 


Selected  Comments  from  Respondents 
Hardware  Service 

Documentation 

•  Vast.  Too  much.  OK  but  vastness  wastes  time  and  there  is  a  lot  of 
duplication 

•  Room  for  improvement.  Varies  from  good  to  diabolical.  Quality  of 
reproduction  and  explanation  pretty  poor 

•  Below  average.  Not  enough,  not  easy  to  follow,  always  behind 
revision  level  of  software 

•  worse  inan  uiaDoiicaL  uratt  copies  sometimes  suppiiea.  i  ne 
binder  costs  extra  and  they  are  behind  on  revision  level 

•  1  out  of  10.  Attributed  to  the  age  of  the  kit 

•  Overcomplex,  verbose  and  no  index 

Remote  Diagnostics 

•  Excellent  innovation — ^very  effective 

•  Improves  speed  of  diagnosis 

•  Archaic.  Nothing  constructive  emerged. 
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Overall,  77%  of  respondents  expressed  satisfaction  with  the  level  of 
systems  software  service  that  they  received.  Exhibit  IV-5  provides  a 
breakdown  of  the  overall  levels  of  satisfaction  expressed  about  the 
principal  constituents  of  the  software  service  product. 


EXHIBIT  lV-5 


Systems  Software 
Support 


Percent  of  Respondents  Expressing  Satisfaction  with  the 
Constituent  Element  of  Systems  Software  Service 


Systems  Software 
Service  Products 

Engineer  Skills 


Documentation 


Software  Installation 


Provision  of  Updates 


Remote  Diagnostics 


20       40       60  80 
Percent  Satisfied 


100 


Sample  Size:  30 


Although  the  percentages  stated  and  provided  in  Exhibit  IV-5  do  not 
support  the  overall  level  of  satisfaction,  the  discrepancy  is  largely  ex- 
plained by  the  fact  that  a  significant  proportion  of  respondents  claimed 
that  the  service  products  were  not  applicable  to  their  operation.  If  these 
figures  are  excluded  from  the  calculation,  the  percentage  of  satisfied 
users  is  as  follows: 


•  Engineer  skills 

68% 

•  Documentation 

76% 

•  Software  installation 

60% 

•  Provision  of  updates 

65% 

•  Remote  diagnostics 

25% 
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These  figures,  which  express  the  percentage  of  users  of  the  services 
within  the  sample,  broadly  support  the  overall  level  of  satisfaction  re- 
ported. 

Only  two  issues  caused  an  appreciable  level  of  concern  among  the 
interviewees.  Twenty-four  percent  cite  problems  with  the  availability 
and  responsiveness  of  appropriately  qualified  staff  capable  of  providing 
an  acceptable  level  of  support,  and  20%  complain  about  the  quality  of 
documentation.  However,  26%  of  respondents  make  a  series  of  com- 
plaints at  the  provision  of  software  updates,  including  11%  who  comment 
on  the  late  delivery  of  new  releases  of  software.  The  remaining  15% 
offer  a  number  of  miscellaneous  complaints,  including  concerns  over  the 
quality  level  of  newly  released  software  and  dissatisfaction  at  the  level  of 
pressure  applied  by  vendors  to  persuade  customers  to  upgrade.  Although 
no  single  issue  emerges  as  a  key  cause  of  concern  among  users,  the 
general  level  of  dissatisfaction  expressed  is  worthy  of  comment. 
Exhibit  IV-7  provides  a  selection  of  comments  that  indicate  the  principal 
areas  of  concern. 

Exhibit  rV-6  illustrates  the  satisfaction  indexes  for  software  service 
derived  from  the  total  sample. 


Satisfaction  Index  for  Software  Service 


Satisfaction  Index  A  SI 

Service  Category 

Large 
Systems 

Medium 
Systems 

Small 
Systems 

Average 

Engineer  Skills 

1.1 

1.0 

1.1 

1.1 

Documentation 

1.4 

1.4 

1.6 

1.5 

Software  Installation 

0.7 

0.6 

0.6 

0.6 

Provision  of  Updates 

0.9 

1.1 

1.2 

1.1 

Remote  Diagnostics 

0.5 

1.0 

0.8 

0.8 

Weighted  Rating 

0.9 

1.0 

1.1 

1.0 

Sample  Size:  1,211 
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The  findings  of  the  in-depth  interviews  are  consistent  with  the  satisfac- 
tion index  insofar  as  they  highlight  the  principal  areas  of  concern  within 
the  areas  of  engineer  skills,  documentation  and  the  provision  of  updates. 
However,  it  will  be  noted  that  the  overall  systems  software  support 
satisfaction  rating  of  1.0  compares  unfavorably  with  that  of 
hardware,  rated  at  0.7.  This  variation  is  in  apparent  contradiction  to 
findings  of  the  in-depth  survey,  which  indicates  a  higher  percentage  of 
satisfied  users  of  systems  software  services  than  of  hardware. 

The  explanation  behind  the  discrepancy  lies  in  the  different  levels  of 
expectation  attached  to  hardware  and  systems  software  service  by  users. 
The  increasing  reliability  levels  of  equipment  coupled  with  the  percep- 
tion that  hardware  service  is  becoming  increasingly  simple  has  resulted 
in  a  rise  in  the  expected  level  of  hardware  performance.  Although  the 
importance  rating  for  software  support  is  broadly  equivalent  to  that  of 
hardware,  the  increasing  complexity  of  software  products  has  resulted  in 
an  understanding,  on  the  part  of  users,  of  the  complexities  involved  in  the 
provision  of  software  support.  This  factor  goes  a  considerable  way 
towards  explaining  the  fact  that  the  main  issue  concerning  engineer  skills 
is  not  the  overall  skill  level  of  the  engineers,  but  the  difficulty  of  identi- 
fying the  person  with  the  appropriate  level  of  knowledge  within  the 
vendor's  organisation. 
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EXHIBIT  IV-7 


Selected  Comments  from  Respondents 
Systems  Software  Support 

General 

•  DisaDDointed  in  service.  Soeed  of  response  on  the  hotline  a 
problem  and  the  technical  knowledge  of  the  person  logging  the  call 
is  also  a  oroblem 

•  Operating  system  support  is  barely  adequate.  There  is  a  lack  of 
documentation  and  new  revisions  are  not  automaticallv  suDolied. 

%Ml                        BIB          ■    i  ^  W%  b  B          B    B                  ■             B    B           *  *       1            *    B         ■          *   ■  \^     bn  B               B    a  N<7  b             W>              B   B   B              B  %^%AB  i    W              \^  Bt^  la^  B  ■  \^  • 

•  Support  is  theoretically  available  but  very  hard  to  get  hold  of.  Have 
old  software  and  expertise  has  evaporated 

•  Pretty  good.  Have  occasional  problems  but  the  provider  responds 
well  and  faults  are  usually  found  in  the  next  release  which  is  good 
enouqh 

Engineer  Skills 

•  Engineers  are  OK  to  good,  but  systems  engineers  are  difficult  to  get 
hold  of  and  not  that  knowledgeable. 

•  Software  engineers  are  OK.  Field  engineers  are  not  involved. 
Software  is  part  of  the  escalation  procedure  and  response  is  a 
problem 

•  Adequate.  Questions  eventually  get  answered  but  it  is  difficult  to  get 
hold  of  the  right  person. 

•  Good  skills  not  needed.  The  problem  is  finding  the  right  person. 

CEISF 
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EXHIBIT  IV-7  (Com.) 


Selected  Comments  from  Respondents 
Systems  Software  Support 

Documentation 

•  Awful 

•  Vast.  Heavy  going  and  never  in  the  right  place. 

•  Better  than  hardware  but  could  be  improved 

•  Behind  revision  levels  but  thorough  and  comprehensive.  Vendor 
has  no  tracking  procedures 

•  Difficult  on  old  equipment.  Experience  time  delays.  Documentation 
is  behind  software  revision  levels  and  is  neither  complete  nor 
thorough 

Software  Installation 

•  Satisfactory  to  good.  Technical  competence  good 

•  Generally  adequate.  If  problems  do  occur  it  takes 
time  to  solve  them 

•  Simple  procedure  properly  conducted 
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EXHIBIT  IV-7  (Cont.) 


Selected  Comments  from  Respondents 
Systems  Software  Support 

Provision  of  System  Software  Updates 

•  News  of  new  releases  slow.  Delivery  is  also  slow. 

•  Causing  problems.  Vendor  is  pushing  an  upgrade  but  the 
customers  are  unwilling  to  move. 

•  Poor.  Not  informed  of  availability.  Difficult  to  get  vendor  to  load  it, 
but  documentation  is  not  good  enough  to  do  it  out  of  the  book. 

•  The  quality  of  information  is  poor,  sketchy  and  uncoordinated 

•  Do  not  always  trust  updates.  Too  many  bugs. 

•  Does  not  happen  and  therefore  not  happy.  Support  is 
withdrawn  too  early 

Remote  diagnostics 

•  Offered  but  not  taken  up 

•  No  problems — excellent 

•  A  bit  lacking.  Not  sharp  enough.  It  needs  to  be  more  focused. 

•  Vendor  is  not  very  good.  Lots  of  requests  for  dumps. 
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Strengths  and 
Weaknesses 


Exhibit  IV-8  illustrates  the  areas  of  strengths  and  weaknesses  highlighted 
by  respondents. 

The  principal  point  to  note  in  comparing  the  perceived  strengths  and 
weaknesses  is  that,  on  balance,  strengths  outweigh  weaknesses,  but  no 
single  area  is  regarded  as  either  overwhelmingly  strong  or  weak.  This 
observation  broadly  supports  the  general  levels  of  satisfaction  expressed 
about  both  hardware  and  systems  software  service. 


EXHIBIT  IV-8 


Strengths  and  Weaknesses 


Weakness 


Technical  Expertise 

Response/Fix  Times 

Large  Company 
Security/Inflexibility 

Reliability/Performance 
of  Product 

Cost/Value  for  Money 
Reiationsiiip  with  Vendor 


Quality/Availability  of  Parts 
Staff  Turnover  of  Vendor 

Miscellaneous 

None 


23 


13 


(A 


I  I  I  I  I  I  I  I  I  I 


0 
0 
0 


(A 


17 

\    .  I 


Strength 


I.I.I 


100    80    60     40    20      0     20    40    60    80  100 
Percentage  of  Respondents  Quoting 


Sample  Size:  30 
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Quality  of  Service         Exhibit  IV-9  indicates  the  percentage  of  respondents  that  regard  the 

overall  quality  of  service  as  satisfactory. 

The  key  point  to  note  from  Exhibit  IV-9  is  the  high  proportion  of  respon- 
dents that  regard  the  overall  quality  of  service  they  receive  as  satisfac- 
tory. However,  the  fact  that  7%  of  respondents  quote  systems  software 
support  as  an  issue,  despite  the  high  overall  rating  the  systems  software 
service  received,  lends  some  support  to  the  interpretation  placed  on  the 
data  reflecting  the  low  level  of  customer  expectation  in  the  area  of  soft- 
ware support. 


EXHIBIT  IV-9 


Respondent  Rating  of  Quality  of  Service 


Comment 


Satisfactory 


7^ 

Software  Support  A  ^ 
an  Issue  y 


Value  for  Money 
Not  Provided 


Unsatisfactory 


73 


Z! 


10 


'A 


10 


±^  I  L 


I         ■  I 


J  I  L 


20       40       60       80  100 
Percent  of  Users 


Sample  Size:  30 
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Other  Services  The  principal  finding  that  emerges  from  respondents  concerning  the 

demand  for  other  services — in  addition  to  hardware  and  software  ser- 
vice— is  that  no  strong  demand  exists  for  any  alternative  service.  Forty- 
seven  percent  of  respondents  state  that  they  have  no  requirement  for  any 
other  service,  and  no  particular  service  offering  attracted  a  proportion  of 
more  than  3%  of  the  sample. 

It  is,  however,  noteworthy  that  13%  of  respondents  stated  that  their 
vendor  makes  no  attempt  to  market  a  range  of  alternative  services,  which 
suggests  that  a  degree  of  ignorance  exists  within  the  user  community 
about  the  benefits  to  be  accrued  from  such  services. 

Equipment  vendors  are  therefore  faced  with  the  need  to  market  services 
strongly  to  create  user  awareness.  However,  indication  was  given  during 
interviews  that  users  have  a  perception  that  equipment  vendor  services 
are  expensive. 
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This  chapter  of  the  report  presents  data  comparing  trends  in  user  satisfac- 
tion with  vendor  service  performance. 

Data  presented  is  divided  by  system  size — large,  medium  and  small 
systems — and  is  presented  in  the  following  formats: 

•  Trends  in  user  satisfaction  with  vendor  hardware  service  and  systems 
software  support  performance  are  shown  in  graphical  format.  These 
trends  indicate  changes  in  user  requirements  for  service  and  related 
vendor  performance  that  have  occurred  between  1989  and  1990. 

-  Changes  in  the  importance  users  place  on  each  aspect  of  service  are 
shown.  Areas  where  importance  ratings  have  increased  between  1989 
and  1990  are  shaded  to  highlight  the  significance  of  changes. 

-  Changes  in  satisfaction  index  (A  SI)  are  shown  relating  the  vendor 
performance  to  user  needs.  Areas  where  user  satisfaction  has  de- 
clined in  1990  have  been  shaded  to  highlight  aspects  of  service  where 
the  vendor  has  not  responded  to  user  needs.  These  changes  may 
relate  to  increased  imponance  or  decreased  satisfaction. 

•  Trends  in  system  failure  rates  are  shown  in  bar  graph  form  to  illustrate 
changes  that  have  occurred  between  1988  and  1990.  System  failure 
rates  are  expressed  as  the  number  of  times  each  year  the  user  perceived 
the  vendor's  system  to  have  failed  completely  for  a  period  of  more  than 
one  hour. 

•  Trends  in  vendor  hardware  service  and  systems  software  support 
response  and  repair/fix  time  performance  are  presented  in  the  form  of 
bar  graphs,  illustrating  changes  that  have  occurred  between  1988  and 
1990.  Response  and  repair/fix  times  are  expressed  as  the  percentage  by 
which  they  exceed  or  fall  short  of  user  requirements. 
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EXHIBIT  V-1 


Hardware  Service  Trends  1989-1990 
Western  Europe — Large  Systems 
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EXHIBIT  V-2 


Hardware  Service  Trends  1989-1990 
Western  Europe — Medium  Systems 
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Hardware  Service  Trends  1989-1990 
Western  Europe — Small  Systems 
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EXHIBIT  V-4 


Systems  Software  Support  Trends  1989-1990 
Western  Europe — Large  Systems 
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Systems  Software  Support  Trends  1989-1990 
Western  Europe — Medium  Systems 
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Systems  Software  Support  Trends  1 989-1 990 
Western  Europe — Small  Systems 

Service 
Aspect 

Importance  Rating 

5.0    6.0  7.0    8.0    9.0  10.0 

Satisfaction  Index  A  SI 
(2.0)  (1.0)   0    1.0  2.0 

Engineer  Skills 
Documentation 

Software 
Installation 

Provision 
of  Updates 

Remote 
Diagnostics 

1      1       1      1       1  1 

8.8^  9.0 

8.3  4  3.4 

m 
m 

8.3  8.4 
8.2  i  8.3 
7.1  8.0 

1       1       1       i  1 

1.1  «r  1-3 

\ 

1.6   i  1.6 

Mm 

0.6  1.0 

V  B 
\  • 
\  * 

1.2  \  1.3 

m 

0.8  ^  0.8 
1 

Sample  Size:  1989  =  401                              1990        ^  Increased  Importance 
1990=  249                      '■•'•1989        □  Decreased  Satisfaction 

CEISF 


©  1991  by  INPUT.  Reproduction  Prohibrted. 


47 


USER  SATISFACTiON— TRENDS  AND  ISSUES,  1990 


INPUT 


EXHIBIT  V-7 


Western  Europe 
System  Failure  Rate  Trends 


4 


3.3 


> 

a. 


CO 


0 

Year: 
Sample  Size: 


1988 


1,593 


1989 


1,626 


1990 
1,211 


□  All  Systems  Q   Medium  Systems 

^   Large  Systems      □   Small  Systems 


48 


©  1991  by  INPUT.  Reproduaion  Prohibited. 


CEISF 


USER  SATISFACTION— TRENDS  AND  ISSUES.  1990 


INPUT 


Western  Europe 
Hardware  Service  Response  Time  Trends 


CD 
O 

CO 


o 

a. 

O 

13 

CD 
> 


o 

X  g 

CD 
O 
X 


c 
o 

o 

a.  --^ 

X  c 
LU  Q 

H-  O 

o  ^ 

w 
"cS 


100 
80 
60 


20 


20 
40 
60 
80 
100 


14 


E]  All  Systems 

^  Large  Systems 

Q  Medium  Systems 

□  Small  Systems 


18 


10 


15 


10 


29 


Year: 


1988 


1989 


1990 


Sample  Size:  1,593 


1,626 


1,211 


©  1991  by  INPUT.  Reproduction  Prohibited. 


49 


USERSATiSFACTION— TRENDS  AND  ISSUES,  1990 


INPUT 


O 

OS 

E 

O 

tl 
0) 
CL 

o 

CD 


Western  Europe 
Hardware  Service  Repair  Time  Trends 


(0 

■5  --^ 

CD 

LU  S:? 

© 
O 
X 
LU 


c 
g 

o 

CD 

X  c 
LU  (D 

■C  CL 
O 

CO 
« 


100 

80 

60 

40 

20 
0 

20 

40 

60 

80 

100 
Year: 


-  11 


□  All  Systems 
^  Large  Systems 

0  Medium  Systems 

□  Small  Systems 


27 


0 


1988 


1989 


1990 


Sample  Size:  1,593 


1,626 


1,211 


©  1991  by  INPUT.  Reproduction  Prohibtted. 


CEISF 


USERSATISFACTION— TRENDS  AND  ISSUES,  1990  INPUT 


EXHIBIT  V-10 


O 

c 

CO 

E 

o 
t: 

(D 

o 
■o 
c 
® 

> 


Western  Europe 
Systems  Software  Support  Response  Time  Trends 


c 
g 

Q> 
CD 
O 
X 
LU 


g 

■■to 
•«— • 

o 

X  c 
LU  Q 

CO 

w 

LJ_ 


100 

80 

60 

40 

20 
0 

20 

40 

60 

80 

100 
Year 


-  28 


^  All  Systems 

^  Large  Systems 

0  Medium  Systems 

□  Small  Systems 


36 


30  28 


Sample  Size: 


1988 
1,593 


1989 


1,626 


1990 


1,211 


CEISF 


©  1991  by  INPUT.  Reproduction  Prohibited. 


51 


USER  SATISFACTION— TRENDS  AND  ISSUES,  1990  INPUT 


EXHIBIT  V-11 


O 

c 
CO 

E 
o 

CD 
£L 

o 
c 

> 


Western  Europe 
Systems  Software  Support  Fix  Time  Trends 


g 

CO 

CD 

"D  ^ 
CD 
CD 
O 
X 


c 
o 

CD 

O.^ 

X  C 
LU  Q 

^  o 

it 

sz 
C/D 
_w 

To 
U. 


100  r 


60 

40 

20 
0 

20 

40 

60 
80 

100 
Year: 


28 


□  All  Systems 
^   Large  Systems 

^   Medium  Systems 


□   Small  Systems 


45  43 


1988 


Sample  Size:  1,593 


1989 


1,626 


1990 


1,211 


52 


©1991  by  INPUT.  Reproduction  Prohibited. 


CEISF 


Key  Service  Trends 


USER  SATISFACTION— TRENDS  AND  ISSUES.  1990 


INPUT 


Key  Service  Trends,  1988-1990 


This  chapter  of  the  report  presents  data  comparing  trends  in  user  percep- 
tion of  vendor  service  performance  between  1988  and  1990. 

Data  relating  to  each  vendor's  service  performance  are  illustrated  in  four 
exhibits  in  the  following  formats: 

•  Trends  in  user  satisfaction  with  vendor  hardware  service  and  systems 
software  support  performance  are  shown  in  graphical  format.  These 
trends  indicate  changes  in  user  requirements  for  service  and  related 
vendor  performance  that  have  occurred  between  1989  and  1990. 

-  The  graphs  show  changes  in  the  importance  users  place  on  each 
aspect  of  service.  Areas  where  importance  ratings  have  increased 
between  1989  and  1990  are  shaded  to  highlight  the  significance  of 
changes. 

-  Changes  in  satisfaction  index  (A  SI)  relating  the  vendors'  perfor- 
mance to  user  needs  as  shown.  Areas  where  user  satisfaction  has 
declined  in  1990  have  been  shaded  to  highlight  aspects  of  service 
where  the  vendor  has  not  responded  to  user  needs.  These  changes 
may  relate  to  increased  importance  or  decreased  satisfaction. 

•  Trends  in  systems  failure  rates  are  shown  in  bar  graph  form  to  illustrate 
changes  that  have  occurred  between  1988  and  1990.  System  failure 
rates  are  expressed  as  the  number  of  times  each  year  the  user  perceived 
the  vendor's  system  to  have  failed  completely  for  a  period  of  more  than 
one  hour. 


©  1991  by  INPUT.  Reproduction  Prohibited. 


53 


USER  SATISFACTION— TRENDS  AND  ISSUES,  1990 


INPUT 


•  Trends  in  vendor  hardware  service  and  systems  software  support 
response  and  repair/fix  time  performance  are  presented  in  the  form  of 
bar  graphs,  illustrating  changes  that  have  occurred  between  1988  and 
1990.  Response  and  repair/fix  times  are  expressed  as  the  percentage 
by  which  they  exceed  or  fall  short  of  user  requirements.  Data  relating 
to  vendor  hardware  service  and  systems  software  support  performance 
is  shown  in  the  same  exhibit. 


Large  Systems  Exhibits  VI- 1  to  VI-20  indicate  trends  in  large  systems  users'  perception 

of  vendor  service  performance  between  1988  and  1990.  Trend  data 
included  is  restricted  to  those  vendors  for  which  the  user  sample  size  is 
considered  by  E^UT  to  be  sufficiently  large  to  provide  a  valid  statistical 
result  (i.e.,  user  samples  larger  than  20). 

Trend  data  is  presented  for  the  following  vendors: 

•  Amdahl 

•  Digital 

•  IBM 

•  ICL 
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EXHIBIT  VI-1 


Hardware  Service  Trends  1 989-1 990 
Amdahl — Large  Systems 
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EXHIBIT  VI-2 


Systems  Software  Support  Trends  1989-1990 
Amdahl — Large  Systems 
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EXHIBIT  VI-6 


Hardware  Service  Trends  1989-1990 
Digital — Large  Systems 
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Systems  Software  Support  Trends  1989-1990 
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System  Failure  Rate  Trends 
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Hardware  Service  Trends  1989-1990 
ICL — Large  Systems 
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Aspect 
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B  

Medium  Systems 


Exhibits  VI-21  to  VI-60  indicate  trends  in  medium  systems  user  percep- 
tion of  vendor  performance  between  1988  and  1990.  Trend  data  included 
is  restricted  to  those  vendors  for  which  the  user  sample  size  is  considered 
by  INPUT  to  be  sufficiently  large  to  provide  a  valid  statistical  result  (i.e., 
user  sample  is  larger  than  20). 

Trend  data  is  presented  for  the  following  vendors: 


Bull 
Digital 

Hewlett-Packard 

ffiM 

ICL 

NCR 

Stratus 

Unisys 


EXHIBIT  VI-21 


Hardware  Service  Trends  1989-1990 
Bull — Medium  Systems 
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Aspect 


Importance  Rating 
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— I  1 — 


Spares 
Availability 

Engineer 
Skills 

Problem 
Escalation 

Documentation 

Remote 
Diagnostics 


0.7  •    ♦  1.5 


0.7       ^  1.3 


:  0.6 


Sample  Size:  1989  =  55  1990        ^  Increased  Importance 

1990  =  38  ' '   1989        □  Decreased  Satisfaction 


CEISF 


©  1991  by  INPUT.  Reprodudion  Prohibited. 


75 


USER  SATISFACTION— TRENDS  AND  ISSUES,  1990 


INPUT 


EXHIBIT  VI-22 


Systems  Software  Support  Trends  1989-1990 
Bull — Medium  Systems 
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EXHIBIT  VI-26 


Service 
Aspect 


Hardware  Service  Trends  1989-1990 
Digital— Medium  Systems 


Importance  Rating 
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EXHIBIT  VI-27 


Systems  Software  Support  Trends  1989-1990 
Digital — Medium  Systems 
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Importance  Rating 
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EXHIBIT  VI-31 


Hardware  Service  Trends  1989-1990 
Hewlett-Packard — Medium  Systems 


Aspect 
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Systems  Software  Support  Trends  1989-1990 
Hewlett-Packard — Medium  Systems 
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Hardware  Service  Trends  1989-1990 
IBM — Medium  Systems 
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Aspect 
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Hardware  Service  Trends  1989-1990 

ICL — Medium  Systems 
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(2.0)  (1.0)   0    1.0  2.0 
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Service 
Aspect 
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Hardware  Service  Trends  1989-1990 
Unisys — Medium  Systems 
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Unisys — Medium  Systems 
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c  

Small  Systems  Exhibit  VI-61  to  VI-80  indicate  trends  in  small  systems  user  perception 

of  vendor  performance  between  1989  and  1990.  Trend  data  included  is 
restricted  to  those  vendors  for  which  the  user  sample  size  is  considered 
by  INPUT  to  be  sufficiendy  large  to  provide  a  valid  stadsdcal  result  (i.e., 
user  sample  is  larger  than  20). 

Trend  data  is  presented  for  the  following  vendors: 

•  Bull 

•  Digital 

•  IBM 

•  ICL 


EXHIBIT  VI-61 


Hardware  Service  Trends  1989-1990 
Bull — Small  Systems 
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importance  Rating 

Satisfaction  Index  A  SI 

Aspect 
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EXHIBIT  VI-66 


Service 
Aspect 


Hardware  Service  Trends  1989-1990 
Digital — Small  Systems 


Importance  Rating 
5.0    6.0   7.0    aO    9.0  10.0 


T  r 


Satisfaction  Index  A  SI 
(2.0)  (1.0)   0    1.0  2.0 


T  r 


T  r 


Spares 
Availability 

Engineer 
Skills 

Problem 
Escalation 

Documentation 

Remote 
Diagnostics 


0.7  #  0.7 


(0.1) 


(0.3) 


Sample  Size:  1989  =  40 
1990  =  29 


1990 
•  ••  •  1 989 


M  Increased  Importance 
□  Decreased  Satisfaction 
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EXHIBIT  Vi-67 


Systems  Software  Support  Trends  1989-1990 
Digital — Small  Systems 


Service 
Aspect 


Engineer 
Skills 

Documentation 

Software 
Installation 

Provision 
of  Updates 

Remote 
Diagnostics 


Importance  Rating 
5.0    6.0  7.0    8.0    9.0  10.0 


Satisfaction  Index  A  SI 

(2.0)  (1.0)  0  1.0  2.0 
— I  1  1       I  — 1— 


0.9 


1.5 


0.5  f  >  1.1 


0.2 


0.1 


0.2 


Sample  Size:  1989  =  40 
1990  =  29 


1990 
I *••  .  1989 


^  Increased  Importance 
□  Decreased  Satisfaction 
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Hardware  Service  Response/Repair  Time  Trends 
Digital — Small  Systems 
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EXHIBIT  VI-70 
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EXHIBIT  VI-71 


Hardware  Service  Trends  1989-1990 
IBM— Small  Systems 


Service 
Aspect 


Importance  Rating 
5.0    6.0  7.0    8.0    9.0  10.0 


T  1  1  \  1  T 


9.2 


Satisfaction  Index  A  SI 

(2.0)  (1.0)  0  1.0  2.0 
— I  1 — 


Spares 
Availability 

Engineer 
Skills 

Problem 
Escalation 

Documentation 

Remote 
Diagnostics 


T 


1  r 


8.6  f  9.3 


6.5 


Sample  Size:  1989  =  59 
1 990  =  43 


1990 
1989 


^  Increased  Importance 
□  Decreased  Satisfaction 
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EXHIBIT  VI-72 


Systems  Software  Support  Trends  1989-1990 
IBM— Small  Systems 


Service 
Aspect 


Engineer 
Skills 

Documentation 

Software 
Installation 

Provision 
of  Updates 

Remote 
Diagnostics 


Importance  Rating 
5.0    6.0   7.0    8.0    9.0  10.0 


T      I       I      I    ""n  r 
8.6  9.0 


8.0  #b  8.3 


6.9 


Satisfaction  Index  A  SI 
(2.0)  (1.0)   0    1.0  2.0 


T  r 


0.7  ♦  ♦  1.3 


(0.4) 


1.6 


Sample  Size:  1989  =  59 
1990  =  43 


■  m  I 


1990 
1989 


^  Increased  Importance 
□  Decreased  Satisfaction 
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EXHIBIT  VI-76 


Hardware  Service  Trends  1989-1990 
ICL— Small  Systems 


Service 

Imnnrtflnpo  Ratino 

Satisfaction  Index  A  SI 

Aspect 

5.0    6.0  7.0    8.0    9.0  10.0 

(2.0)  (1.0)   0  1.0 

2.0 

Spares 
Availability 

1       1       1       1       1  1 
8.4  •  8.5 

}■ 

1       1       1  1 
0.9  m 

1  / 

1 

1.0 

Engineer 
Skills 

8.5  1^  8.9 

0.7  4 

0.8 

Problem 
Escalation 

7.7  ^  8.1 

0.7  ^  \ 
1  •. 

\  ^'^ 

Documentation 

7.4  #  7.5 

0.9  hi 

►  1.3 

Remote 
Diagnostics 

6.8  8.2 

0.,, 

0.5 

Sample  Size:  1989  =  81  1990        ^  Increased  Importance 

1990  =  46  .  .  #.  .  1989        □  Decreased  Satisfaction 
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EXHIBIT  VI-77 


Systems  Software  Support  Trends  1989-1990 

ICL— Small  Systems 

Service 
Aspect 

Importance  Rating 
5.0    6.0  7.0    8.0    9.0  10.0 

Satisfaction  Index  A  SI 
(2.0)  (1.0)   0    1.0  2.0 

Engineer 
Skills 

Documentation 

Software 
Installation 

Provision 
of  Updates 

Remote 
Diagnostics 

1      1       1      1       1  1 
8.8  ^  8.7 

8.1  ♦  8.1 

\ 

8.2  !♦  8.5 

/; 

7.8  4  •  8.4 

V 

7.7  4^  7.9 

1       1       1      1  1 

0.8  1.3 

1.7  ♦^I.S 

1.0  1.4 

1.2  f 

/      '  2.2 

0.7  ♦  ♦  1.2 

Sample  Size:  1989  =81                                 1990        M  Increased  Importance 
1990  =46                        ■ ■   1989        □  Decreased  Satisfaction 
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System  Failure  Rate  Trends 
ICL— Small  Systems 
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EXHIBIT  VI-80 
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1990  Service  Performance 
Comparisons 


This  chapter  of  the  report  is  structured  to  allow  comparison  of  user 
satisfaction  ratings  for  service  performance.  Data  presented  relates  to 
both  vendors  and  key  country  markets  in  Western  Europe  and  covers  the 
following  specific  aspects  of  service: 

•  Hardware  service 

-  Spares  availability 

-  Engineer  skills 

-  Problem  escalation 

-  Documentation 

-  Remote  diagnostics 

•  Systems  Software  Support 

-  Engineer  skills 

-  Documentation 

-  Software  installation 

-  Provision  of  updates 

-  Remote  diagnostics 


Vendor  Comparisons     Exhibits  VII- 1  to  VII- 10  provide  data  allowing  comparison  between  user 

perception  of  a  number  of  vendors'  service  performance  achievements  in 
five  specific  aspects  of  hardware  service  and  systems  software  support. 
Data  included  in  these  exhibits  is  restricted  to  those  vendors  for  which  the 
user  sample  is  considered  by  INPUT  to  be  sufficiently  large  to  provide  a 
valid  statistical  result  (i.e.,  a  user  sample  larger  than  20). 

Comparative  data  is  presented  for  the  following  vendors: 
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•  Large  systems 

-  Amdahl 

-  Digital 

-  IBM 
=  ICL 

-  Wang 

•  Medium  systems 

-  Bull 

-  Digital 

-  Hewlett-Packard 

-  ffiM 

-  ICL 

-  NCR 

-  Philips 

-  Stratus 

-  Unisys 

-  Wang 

•  Small  systems 

-  Bull 

-  Digital 

-  IBM 

-  ICL 

-  Wang 
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EXHIBIT  VIM 


Vendor  Performance  Comparisons 
Hardware  Service— Spares  Availability 


Vendor 


Satisfaction  Index  A  SI 


Large  Systems 
(3)  (2)  (1)    0    1  2 


T  T 


Medium  Systems 
(3)  (2)  (1)    0    1     2  3 


T — r 


Small  Systems 
(3)  (2)  (1)    0    1  2 


Amdahl 

Bull 

Digital 

Hewlett- 
Packard 

IBM 

ICL 

NCR 

Philips 

Stratus 

Unisys 

Wang 


0.3 


1.3 


1.1 


0.6 


1.5 


3 


0.7 
1.1 


0.5 
^0.9 


m 


1.4 


7" 


2J 


0.7 


1.3 


7 


2.9 


1  r 

0.6 
0.7 


]o.5 
0.9 


1.4 


Sample  Size:    Large  Systems:  324 


Medium  Systems:  638 


Small  Systems:  249 
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Vendor  Performance  Comparisons 
Hardware  Service — Engineer  Skills 


Vendor 


Satisfaction  Index  A  SI 


Large  Systems 
(3)   (2)  (1)    0    1  2 


1  r 


1  1  r 


Medium  Systems 

(3)   (2)  {1}    0     1     2  3 
"1-^ — I  r 


Small  Systems 
(3)   (2)  (1)    0     1  2 
1  !  1  T  1  f~ 


3 

T 


Amdahl 

Bull 

Digital 

Hewlett- 
Packard 

IBM 

ICL 

NCR 

Philips 

Stratus 

Unisys 

Wang 


0.4 


1.1 


0.8 


0.4 


m 


1.6 


^0.6 
]o.5 
^0.8 


0.7 


2j 


0.8 
1.3 
1.2 
0.7 


1.1 


7 


2.0 


0.2 


0.9 

0.9 
0.7 


1,0 


Sample  Size:    Large  Systems:  324 


Medium  Systems:  638 


Small  Systems:  249 
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EXHIBIT  VII-3 


Vendor  Performance  Comparisons 
Hardware  Service — Problem  Escalation 


Vendor 


Satisfaction  Index  A  SI 


Large  Systems 
(3)  (2)  (1)    0    1  2 


T  r 


T  r 


3 

-r 


Medium  Systems 
(3)   (2)  (1)    0    1     2  3 
~l  1  1  1  1  1  T 


Small  Systems 

(3)  (2)  (1)  0  1  2 
T 


1  r 


T — r 


Amdahl 

Bull 

Digital 

Hewlett- 
Packard 

IBM 

ICL 

NCR 

Philips 

Stratus 

Unisys 

Wang 


(0.2) 


0.6 


0.7 
0.5 


2.2 


1 0.6 


-J 


0.8 


0.7 


^1.0 


Id 


0.8 
0.7 


0.3 
0.7 


Z 
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1.4 


Sample  Size:    Large  Systems:  324 
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EXHIBIT  VII-4 


Vendor 


Amdahl 

Bull 

Digital 

Hewlett- 
Packard 

IBM 

ICL 

NCR 

Philips 

Stratus 

Unisys 

Wang 


Vendor  Performance  Comparisons 
Hardware  Service — Documentation 


Satisfaction  Index  A  SI 


Large  Systems 
(3)  (2)  (1)    0    1  2 


T 


(0.3) 


0.9 


0.3 


0.9 


1.7 


3 


Medium  Systems 
(3)   (2)  (1)    0    1     2  3 
— I — I — r 


^0.5 


^0.7 


1.1 


0.7 


0.8 


Z 


0.7 


Small  Systems 
(3)   (2)  (1)    0     1  2 
I     I  1 — 


0.9 
1.0 


1.1 
1.3 


1.3 


Sample  Size:    Large  Systems:  324 


Medium  Systems:  638 


Small  Systems:  249 
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Vendor 


Amdahi 

Bull 

Digital 

Hewlett- 
Packard 

IBM 

ICL 

NCR 

Philips 

Stratus 

Unisys 

Wang 


Vendor  Performance  Comparisons 
Hardware  Service — Remote  Diagnostics 


Satisfaction  Index  A  SI 


Large  Systems 
(3)  (2)  (1)    0    1     2  3 
-i  r~ — I  ]  1  1  r 


(0.6) 


|0.6 

|0.4 
1 0.5 


Medium  Systems 
(3)  (2)  (1)    0    1     2  3 
I     I     '  I 


0.1 


r 


0.1 


]o.8 

0.6 
^0.8 


^0.4 


A 


1.9 


3.1- 


Small  Systems 
(3)   (2)  (1)    0     1  2 
— I — r 


(0.1) 


0.3 


0.7 


0.5 


1.2 


Sample  Size:    Large  Systems:  324 


Medium  Systems:  638 


Small  Systems:  249 
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EXHIBIT  VII-6 


Vendor 


Amdahl 

Bull 

Digital 

Hewlett- 
Packard 

IBM 

ICL 

NCR 

Philips 

Stratus 

Unisys 

Wang 


Vendor  Performance  Comparisons 
Systems  Software  Support— Engineer  Skills 


Large  Systems 
(3)  (2)  (1)    0    1  2 

"T  1  1  


1.0 


1.4 


1.3 


0.5 


n.7 


Satisfaction  Index  A  SI 


Medium  Systems 
(3)  (2)  (1)    0    1     2  3 
T 


T  r 


1.1 

^1.1 


1.3 


0.6 
1^1.1 
1.0 


2]0.8 
^1.3 


A 


A 


2.1 


Small  Systems 
(3)   (2)  (1)    0     1  2 
1  "T 


T 


0.4 
0.9 


0.7 
0.8 


1.4 


Sample  Size:    Large  Systems:  324 


Medium  Systems:  638 


Small  Systems:  249 
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EXHIBIT  VII-7 


Vendor 


Amdahl 

Bull 

Digital 

Hewlett- 
Packard 

IBM 

ICL 

NCR 

Philips 

Stratus 

Unisys 

Wang 


Vendor  Performance  Comparisons 
Systems  Software  Support — Documentation 


Satisfaction  Index  A  SI 


Large  Systems 
(3)  (2)  (1)    0    1  2 


1  1  r 


T  1  r 


1.3 


1.2 
1.2 


1.8 


Medium  Systems 
(3)   (2)  (1)    0     1     2  3 


T  1  r 


Z 


I  1 


1.6 


1.4 
1.4 
1.5 


1.2 


1.2 


Z 


1.6 


7 


z 


2.5 


Small  Systems 
(3)   (2)  (1)    0     1     2  3 


I     1  r 


1.6 


1.1 


1.1 


1.8 


2.8 


Sample  Size:    Large  Systems:  324 


Medium  Systems:  638 


Small  Systems:  249 
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EXHIBIT  VII-8 


Vendor  Performance  Comparisons 
Systems  Software  Support — Software  Installation 


Satisfaction  Index  A  SI 

Vendor 

Large  Systems 
(3)  (2)  (1)    0    1     2  3 

Medium  Systems 
(3)  (2)  (1)    0    1     2  3 

Small  Systems 
(3)  (2)  (1)    0    1     2  3 

Amdahl 

1        i  1 

0.2 

1     1  1 

1      i  1 

1     1  1 

1      1  1 

Bull 

m 

0.8 

0.8 

Digital 

^1.1 

3o.3 

]0.2 

Hewlett- 
Packard 

7] 

0.4 

IBM 

0.9 

0.6 

ICL 

|o.7 

1.0 

1.0 

NCR 

^  1.1 

Philips 

]o.5 

Stratus 

]o.5 

Unisys 

0.8 

Wang 

1.9 

// / 

0.7 

Sample  Size:    Large  Systems:  324  Medium  Systems:  638         Small  Systems:  249 
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Vendor 


Vendor  Performance  Comparisons 
Systems  Software  Support — Provision  of  Updates 


Satisfaction  Index  A  SI 


Large  Systems 
(3)  (2)  (1)    0    1  2 


T  r 


3 


Medium  Systems 

(3)  (2)  (1)  0  1  2  3 
1  1  1 — 


T  T 


Small  Systems 
(3)  (2)  (1)    0    1  2 

T 


T 


T 


-r- 

0.6 
0.7 


Amdahl 

Bull 

Digital 

Hewlett- 
Packard 

IBM 

ICL 

NCR 

Philips 

Stratus 

Unisys 

Wang 


0.5 


1.4 


1.0 

1.0 


2  0.6 


2  0.8 


1.7 


^1.0 


0.5 

1.2 
1.3 


'A 


1.1 

1.2 


2.3 


Sample  Size:    Large  Systems:  324 


Medium  Systems:  638 


Small  Systems:  249 
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Vendor  Performance  Comparisons 
Systems  Software  Support — Remote  Diagnostics 


Vendor 


Amdahl 

Bull 

Digital 

Hewlett- 
Packard 

IBM 

ICL 

NCR 

Philips 

Stratus 

Unisys 

Wang 


Satisfaction  Index  A  SI 


Large  Systems 
(3)  (2)  (1)    0    1  2 
— I  r 


(0.5) 


3 

-r 


1.4 


0.7 
1.2 


Medium  Systems 

(3)  (2)  (1)  0  1  2  3 
"T — r 


T 


T  1  T 


0.8 

]l.O 

D.7 

M.I 

.6 

1.3 

^1.5 

^0. 

4 

1.1 


2.5 


Small  Systems 

(3)  (2)  (1)  0  1  2 
I  I — I     I — I — r 


(0.4) 


0.9 


0.2 


0.7 


1.4 


Sample  Size:    Large  Systems:  324 


Medium  Systems:  638 


Small  Systems:  249 
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B  

Key  Country 
Market  Comparisons 


Exhibit  Vn-1 1  to  Vn-20  provide  data  allowing  comparison  between  user 
perception  of  vendor  service  performance  achievements  in  four  major 
Western  European  country  markets: 

•  France 

•  Germany 

•  Italy 

•  United  Kingdom 

Data  presented  in  these  exhibits  relates  to  five  aspects  of  hardware  ser- 
vice and  five  aspects  of  systems  software  support. 


EXHIBIT  VII-11 


Country  Performance  Comparisons 
Hardware  Service — Spares  Availability 


Country 


France 

Germany 

Italy 

United 
Kingdom 


Satisfaction  Index  A  SI 


Large  Systems 
(3)  (2)  (1)    0    1  2 

"T 


T  T 


r"^ — r 

1.0 


3 


1.5 


1 0.8 
0.5 


Medium  Systems 

(3)  (2)  (1)  0  1  2  3 
"T 


1  r 


I  I 


V/. 

1.1 

1.0 

1.0 

Small  Systems 

(3)   (2)  (1)    0     1  2 
—I — r 


1  r 


0.8 


1.4 


0.6 

0.7 


Sample  Size:    Large  Systems:  324 


Medium  Systems:  638 


Small  Systems:  249 
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EXHIBIT  VII-12 


Country  Performance  Comparisons 
Hardware  Service— Engineer  Skills 


Satisfaction  Index  A  SI 

Country 

Large  Systems 
(3)  (2)  (1)    0    1     2  3 

Medium  Systems 
(3)  (2)  (1)    0    1     2  3 

Small  Systems 
(3)   (2)  (1)    0    1     2  3 

France 

i     1  1 

1     1  1 
So.8 

1     i  1 

1     1  1 

1     1  1 

1  1 

Germany 

1.3 

1.3 

1.6 

Italy 

United 
Kingdom 

|o„4 
^0.6 

2  0.6 

]0.5 

"lo.s 

Sample  Size:    Large  Systems:  324 

Medium  Systems:  638 

Small  Systems:  249 

EXHIBIT  VII-13 


Country  Performance  Comparisons 
Hardware  Service — Problem  Escalation 


Country 

Satisfaction  Index  A  SI 

Large  Systems 
(3)   (2)  (1)    0     1     2  3 

Medium  Systems 
(3)   (2)  (1)    0    1     2  3 

Small  Systems 
(3)   (2)  (1)    0     1     2  3 

France 

Germany 

Italy 

United 
Kingdom 

1     1     1  1 

1  1 

1     1  1 

1     1  1 

1     1  1 

1      1  1 

1 

|l.4 

0.9 
1.1 

1.4 

]0.4 
|o.4 

/^0.7 
^0.7 

^0.5 
0.6 

Sample  Size:    Large  Systems:  324  Medium  Systems:  638         Small  Systems:  249 
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EXHIBIT  VII-14 


Country  Performance  Comparisons 
Hardware  Service — Documentation 


Country 


Satisfaction  Index  A  SI 


Large  Systems 
(3)  (2)  (1)    0    1     2  3 


T  r 

0.7 

0.8 


Medium  Systems 
(3)  (2)  (1)    0    1     2  3 


1  1 — r 


Small  Systems 
(3)  (2)  (1)    0     1     2  3 


T  1  r 


T — I — r 

1.6 


France 

Germany 

Italy 

United 
Kingdom 


(1.0) 


(0.4) 


0.6 


1.6 


^  1-5 


0.8 


1.5 


0.5 
0.7 


Sample  Size:    Large  Systems:  324 


Medium  Systems:  638 


Small  Systems:  249 


EXHIBIT  VII-15 


Country  Performance  Comparisons 
Hardware  Service — Remote  Diagnostics 


Country 

Satisfaction  Index  A  SI 

Large  Systems 
(3)  (2)  (1)    0     1     2  3 

Medium  Systems 
(3)   (2)  (1)    0     1     2  3 

Small  Systems 
(3)   (2)  (1)    0     1     2  3 

France 

Germany 

Italy 

United 
Kingdom 

1     1  1 

1     1  1 

^  1.2 

i  ^■'^ 

1  0.6 

1      1  1 

1     1  1 

3  0.3 
.J 

1     1  1 

(1.4) 

(0.4)  [ 

1      1  1 
1 

^  0.5 

Sample  Size:    Large  Systems:  324  Medium  Systems:  638         Small  Systems:  249 
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EXHIBIT  VII-16 


Country  Performance  Comparisons 
Systems  Software  Support— Engineer  Skills 


Satisfaction  Index  A  SI 

Country 

Large  Systems 
(3)  (2)  (1)    0  1 

2  3 

Medium  Systems 
(3)  (2)  (1)    0    1     2  3 

Small  Systems 
(3)  (2)  (1)    0     1     2  3 

France 

1     1  1 

!  1 

1.3 

i     1  1 

\ 

'  1 

i  1 

1     1  1 

1      1  1 

0.9 

Germany 

;i.5 

1.2 

Italy 

^0.9 

0.8 

1.1 

United 
Kingdom 

|o.9 

1.3 

0.7 

Sample  Size:    Large  Systems:  324  Medium  Systems:  638         Small  Systems:  249 


EXHIBIT  VII-17 


Country  Performance  Comparisons 
Systems  Software  Support — Documentation 


Country 

Satisfaction  Index  A  SI 

Large  Systems 
(3)  (2)  (1)    0    1     2  3 

Medium  Systems 
(3)  (2)  (1)    0     1     2  3 

Small  Systems 
(3)  (2)  (1)    0     1     2  3 

France 

Germany 

Italy 

United 
Kingdom 

1     1  1 

1     1  1 

1     1  1 

1     1  1 

1     1  1 

2.2 

1.7 

1.0 

1 

.2 

1 

1.5 

Sample  Size:    Large  Systems:  324  Medium  Systems:  638         Small  Systems:  249 
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EXHIBIT  VII-18 


Country  Performance  Comparisons 
Systems  Software  Support — Software  Installation 


Country 


Satisfaction  Index  A  SI 


Large  Systems 
(3)  (2)  (1)    0    1  2 


T  r 


3 

-r 


Medium  Systems 
(3)  (2)  (1)    0    1  2 


3 


1  1  T 


Small  Systems 
(3)   (2)  (1)    0     1  2 


1 — ~i  r 


T — r 


I      I  r 


France 

Germany 

Italy 

United 
Kingdom 


0=4 


^0.6 


1.6 


jO.6 
1 0.5 


I  r 


^0.3 
^0.5 


0.6 


1.1 


0.7 


0.0 


Sample  Size:    Large  Systems:  324 


Medium  Systems:  638 


Small  Systems:  249 


EXHIBIT  VII-19 


Country  Performance  Comparisons 
Systems  Software  Support — Provision  of  Updates 


Country 


Satisfaction  Index  A  SI 


Large  Systems 
(3)  (2)  (1)    0    1     2  3 


Medium  Systems 
(3)   (2)  (1)    0     1     2  3 


Small  Systems 
(3)   (2)  (1)    0     1  2 


T — r 


France 

Germany 

Italy 

United 
Kingdom 


T  1  r 

^1.7 


I  r 


1.3 


1.1 


0.6 


T  T 


T — r 


1.0 


1.4 


1.4 


0.9 
0.8 


Sample  Size:    Large  Systems:  324 


Medium  Systems:  638 


Small  Systems:  249 
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EXHIBIT  VII-20 


Country  Performance  Comparisons 
Systems  Software  Support — Remote  Diagnostics 


Country 

Satisfaction  Index  A  SI 

Large  Systems 
(3)  (2)  (1)    0    1     2  3 

Medium  Systems 
(3)  (2)  (1)    0    1     2  3 

Small  Systems 
(3)  (2)  (1)    0    1     2  3 

France 

Germany 

Italy 

United 
Kingdom 

1     1  1 

(0.4)  1 

1      1  1 

1     1  1 

1  1 

1     1  1 

1      1  1 

V/a 

1.4 
1.6 
1.5 

1  1.5 
1.2 

(1.3) 

'/A 

(0.7)  Q 

^0.4 

Sample  Size:    Large  Systems:  324  Medium  Systems:  638         Small  Systems:  249 
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General  User  Questionnaire 


1.       What  is  the  make  and  model  number  of  the  main  computer  on  your  site  and  how  many  do  you 
have? 

Make   


Model  (CRITICAL  INFORMATION) 

Units   

2.        Are  you  the  person  who  is  knowledgeable  on  the  servicing  of  this  system? 
 Yes   No 

(If  not  then  obtain  the  name  of  the  correct  person  and  start  again.) 

Name  of  person  responsible:  


3.        Do  you  have  another  system?  What  is  the  make  and  model  number  of  that  system  and  how 
many  do  you  have? 

Make   


Model  (CRITICAL  INFORMATION) 

Units   

All  of  the  following  questions  that  I  am  going  to  ask  you  are  related  to  your 
 system.  (Write  in  system  type.) 

(To  confirm,  read  out  the  make  and  model  number.) 
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4.       So  that  we  can  ensure  that  we  get  a  proper  cross-section  of  industry  and  commerce,  can  you 
tell  me  what  is  the  main  business  sector  of  your  company?  (Read  out  the  list  to  allow  for  best 
choice.  Then  circle  appropriate  answer.) 

Business  sector 


•  Manufacturing  1 

•  Distribution  2 

•  Transportation  3 

•  Utilities  4 

•  Banking  and  Finance  5 

•  Insurance  6 

•  Government  7 

•  Services  8 
Other/Don't  Know  9 


I  would  like  to  ask  you  some  questions  relating  to  the  vendor  that  services  your  computer  system. 

5.        Could  you  please  rate  the  importance  of  the  following  criteria  in  selecting  your  service  ven- 
dor, on  a  scale  of  0  to  10  (0  =  low,  10  =  high). 

Criteria  Rating 

a.  Price   

b.  Quality  of  service   

c.  Guaranteed  system  availability  level  •  

d.  Guaranteed  availability  of  spare  parts   

e.  Technical  expertise   

f.  Fast  response  time   

g.  Availability  of  software  support   

h.  Ability  to  provide  other  services   

i.  Contract  flexibility   

j.  Ability  to  service  other  products   

k.  Vendor  reputation   

6a.      Would  you  please  tell  me  who  services  your  computer  system  hardware?  (Remind  the  user 
 system.) 

(Please  circle  appropriate  vendor  type;  multiple  answers  are  allowed.) 

Manufacturer  1 

Dealer/distributor  1 

Third-party  maintenance  company  1 

Own  company  1 

Other  1 
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(If  the  respondent  answered  YES  to  third-party  maintenance,  ask  the  following  question.  If 
not,  go  to  question  7.) 


6b.      I  notice  that  your  system,  or  part  of  it,  is  serviced  by  a  third-party  maintenance  company. 
Could  you  tell  me  the  reason  why  you  use  third-party  maintenance? 

(Please  circle  appropriate  answer,  multiple  answers  allowed.) 


•  Lower  cost  1 

•  Local  service  1 

•  Single-source  service  1 

•  TPM  service  higher  quality  1 

•  More  flexible  contract  1 

•  Other/Don't  know  9 


7a.      I  notice  that  you  do  not  use  a  third-party  maintenance  company;  is  there  a  reason  for  this? 
(Please  circle  appropriate  answer,  multiple  answers  allowed.) 


Satisfied  with  manufacturer  1 

Manufacturer  has  an  advantage  1 

TPM  cannot  suppon  software  1 

Tied  to  manufacturer  with  contract  1 

Fear  of  system  supplier  response  1 

Considered  and  rejected  TPM  1 

TPM  financial  weakness  1 

Unaware  of  TPM  1 

Other/Don't  know  9 


7b.      Assuming  you  were  approached  by  a  TPM  company,  at  what  level  of  price  reduction  would 
you  consider  using  a  TPM  vendor  to  service  your  computer  hardware? 

(Please  circle  appropriate  answer.  Only  one  answer  allowed.) 


•  1%  -  10%  1 

•  11% -20%  1 

•  21% -30%  1 

•  31% -40%  1 

•  41% -50%  1 

•  50%+  1 

•  Unwilling  at  any  price  1 

•  Other/Don't  know  9 
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8. 


How  important  is  it  that  your  service  vendor  communicates  with  you  regularly  and  effectively 
to  advise  you  of,  for  example: 


The  status  of  your  system 
Possible  problems 
Repair  plans 

Availability  of  spare  parts 
Routine  visits 

Hardware  and  software  changes 


> 
> 


> 


>  INTERVIEWER 

>  PROMPTS 


> 


Could  you  please  provide  an  importance  and  satisfaction  rating  on  a  scale  of  0  to  10,  where  0 
is  of  no  importance  or  indicates  total  dissatisfaction,  and  10  is  at  top  importance  or  indicates 
that  you  are  fully  satisfied. 

•  Importance   . 

•  Satisfaction  


9a.      Would  you  prefer  all  hardware  maintenance  and  software  support  to  be  provided  by  one 
service  vendor  at  each  site?  If  yes,  what  would  your  interest  level  be? 

Level  of  interest:  (please  circle) 

Low  Medium  High 

(Circle  answer.) 


Yes 
No 

Don't  know 


1 
1 
9 


(If  the  respondent  answered  YES,  ask:) 


9b.      Who  would  you  prefer  that  vendor  to  be? 


Please  circle  appropriate  answer,  multiple  answers  allowed.) 


The  manufacturer  of  your  main  hardware 

Dealer/distributorA^AR 

TPM  company 

One  of  your  hardware  manufacturers 
Don't  know/other 


1 
1 
1 
1 
9 


Note:  VAR  is  a  value-added  reseller. 
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I  would  now  like  to  ask  you  some  questions  about  the  hardware  maintenance  of  your  computer 
system.  (Reaffirm  the  system  type  ) 

Some  of  the  questions  are  scaled  with  ratings  from  0  to  10.  Zero  (0)  represents  zero  importance  or 
satisfaction,  5  is  average,  and  10  represents  top  importance  or  full  satisfaction. 


10.      What  is  your  rating  for  the  importance  of  hardware  maintenance  to  your  business  and  how 
satisfied  are  you  with  your  service  vendor's  performance? 

•  Importance  rating  

•  Satisfaction  rating   


11.      If  we  define  systems  availability  as  the  percentage  of  your  normal  working  hours  that  the 
system  is  operational  (disregarding  non-critical  peripheral  breaks),  what  percentage  has  that 
been  for  your  system  over  the  last  twelve  months? 

•    Percentage  % 


12.      How  many  times  each  year  does  your  system  fail  completely  for  a  period  of  greater  than  one 
hour? 

•    Per  year  

And  what  percentage  of  these  system  failures  are  due  to: 


Hardware   % 

Systems  software   % 

Applications  software   % 

Other  (i.e.,  power  failure)   % 


(Please  check  that  percentages  add  up  to  100.) 

13.  What  is  your  rating  for  the  imponance  of  systems  availability  (scale  0  -  10),  and  what  is  your 
level  of  satisfaction? 

•  Importance  rating   

•  Satisfaction  rating   

14.  Defining  hardware  response  time  as  the  time  it  takes  between  reponing  a  fault  and  the 
arrival  of  the  service  engineer  on  site  (in  working  hours,  that  is  to  say  8  hours  =  1  working 
day),  what  response  time  (in  hours)  do  you  find  acceptable  and  what  did  you  actually  experi- 
ence as  an  average  over  the  last  twelve  months? 
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Acceptable   Hours 

Experienced   Hours 


15.  If  repair  time  is  defined  as  the  time  taken  to  get  the  system  fully  operational  from  the  time 
the  engineer  arrives  on  site,  then  what  time  do  you  find  acceptable  (in  working  hours)  and 
what  time  did  you  experience  in  the  last  twelve  months? 

(Note:  8  hours  =  1  working  day/shift) 

•  Acceptable   ,  Hours 

•  Experienced   Hours 

16.  I  would  now  like  to  go  through  a  list  of  five  aspects  of  hardware  maintenance  and  ask  you  to 
give  an  importance  and  satisfaction  rating  for  each  (scale  0  -  10). 

Importance  Satisfaction 

•  Spares  availability     

•  Engineer  skills     

•  Problem  escalation     

•  Documentation   

•  Remote  diagnostics     

17.  How  important  is  it  that  your  system  supplier  provides  a  hardware  consultancy/planning 
service  to  support  your  operations  and  how  satisfied  are  you  with  the  service  provided? 
(Scale  0  -  10) 

•  Importance   

•  Satisfaction   


18.      If  possible,  I  would  like  you  to  provide  some  information  on  hardware  maintenance  pricing. 

a.   What  percentage  price  increase  or  decrease  did  you  pay  for  hardware 
maintenance  in  the  year  1989? 

Increase   % 

•  Decrease   % 

•  No  change  1  (circle) 


b.  What  do  you  expect  the  price  changes  for  hardware  maintenance  to  be  in  the 
future,  in  percentage  terms  per  annum? 
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•  Increase 

•  Decrease 


% 
% 


No  change 


1  (circle) 


c.   How  important  do  you  rate  hardware  maintenance  pricing  and  how  satisfied 
are  you  with  the  price  you  currentiy  pay?  (Scale  0-10) 

•  Importance  rating  ^ 

•  Satisfaction  rating   

19.      Which  type  of  hardware  maintenance  contract  do  you  currently  have  on  the  main 
part  of  your  system? 

(Please  circle  appropriate  answer,  only  one  answer  allowed.) 

•  Warranty  1 

•  Three-year  1 

•  One-year  1 

•  Time  and  materials  1  . 

•  None  1 


I  would  like  to  ask  you  some  questions  relating  to  the  service  you  get  from  your  software  support 


These  questions  relate  to  systems  software — not  applications. 

As  before,  some  of  the  questions  are  scaled  with  ratings  from  0  to  10.  Zero  (0)  represents  zero  impor- 
tance or  satisfaction,  5  is  average  and  10  is  top  importance  or  full  satisfaction. 

20.  Who  supports  your  systems  software? 

(Please  circle  appropriate  answer,  multiple  answers  allowed.) 

•  Hardware  manufacturer  1 

•  Software  house  1 

•  Software  product  vendor  1 

•  Value-added  reseller  (VAR)  1 

•  In-house  1 

•  Other/Don't  know  9 

21.  What  is  your  rating  for  the  importance  of  systems  software  support  to  your  business  and  what 
is  your  satisfaction  with  your  vendor's  systems  support  activities?  (Scale  0-10) 


vendor. 


CEISF 


©  1991  by  INPUT.  Reproduction  Prohibited. 


159 


USER  SATISFACTION— TRENDS  AND  ISSUES.  1990 


INPUT 


•  Importance  rating 

•  Satisfaction  rating 


22.      What  percentage  of  systems  software  problems  are  solved  by  telephone,  and  how  long  does 
this  take  in  elapsed  time  from  the  time  it  is  alerted  to  the  service  engineer? 

•  Solved  by  phone   % 

•  Elapsed  time   Hours 


23.      For  those  problems  not  possible  to  solve  over  the  telephone,  what  response  time  would  you 
find  acceptable,  and  what  time  (on  average  and  in  working  hours)  have  you  experienced  over 
the  last  twelve  months?  (Take  response  time  to  mean  from  the  time  the  problem  is  reported 
to  the  arrival  of  the  engineer  on  site.) 

•  Acceptable   Hours 

•  Experienced   Hours 


24.  If  fix  time  is  defined  as  the  time  taken  to  get  the  system  fully  operational  from  the  arrival  of 
the  engineer  on  site,  then  what  time  (in  working  hours)  do  you  find  acceptable,  and  what  did 
you  experience  over  the  last  twelve  months? 

Acceptable  .  Hours 

•    Experienced  -   Hours 


25.      I  would  like  to  go  through  a  list  of  five  aspects  of  systems  software  support  and  ask  you  to 
give  an  importance  and  a  satisfaction  rating  for  each.  (Scale  0-10) 


Importance  Satisfaction 


Engineer  skills 
Documentation 
Software  installation 
Provision  of  updates 
Remote  diagnostics 


26.      How  important  is  it  that  your  system  supplier  provides  a  systems  software  consultancy/ 

planning  service  to  support  your  operations  and  how  satisfied  are  you  with  the  service  pro- 
vided? (Scale  0  -  10) 

•  Importance  rating   

•  Satisfaction  rating   
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27.      If  possible  I  would  like  you  to  provide  some  information  on  systems  software  support 
pricing. 

a.  What  percentage  price  increase  or  decrease  did  you  pay  for  systems 
software  support  in  the  year  1989? 

•  Increase   % 

•  Decrease   % 

•  No  change  1  (circle) 


b.  What  do  you  expect  the  price  changes  for  systems  software  support  to  be 
in  the  future,  in  percentage  terms  per  annum? 

•  Increase   % 

•  Decrease  % 

•  No  change  1  (circle) 

c.  How  important  do  you  rate  systems  software  support  pricing  and  how 
satisfied  are  you  with  the  price  you  currently  pay?  (Scale  0  -  10) 

•  Importance  rating   

•  Satisfaction  rating   


28.      Which  type  of  systems  software  support  contract  do  you  currentiy  have? 
(Please  circle  appropriate  answer.  Only  one  answer  allowed.) 

•  Support  included  in  software  Ucense  fee  1 

•  Three-year  contract  1 

•  One- year  contract  1 

•  Ad  hoc  1 

•  None  1 


29.      To  conclude  this  questionnaire,  I  am  particularly  interested  in  obtaining  your  views  on  other 
services  or  modified  current  service  offerings  that  your  service  suppliers  could  provide  that 
would  help  to  improve  the  running  of  your  computer  systems. 

Could  you  say  which  of  the  following  services  your  service  vendor  is  currently  contracted  to 
supply  and  which  you  would  like  your  service  vendor  to  provide?  Also,  could  you  give  a 
level  of  interest  rating  against  each  in  the  range  0  to  10,  where  0  =  no  interest,  5  =  average 
interest  and  10  =  must  have? 
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(Please  circle  appropriate  answer  and  give  LOI  rating.) 

Currentiy 

Contracted       Require  LOI 

•  Configuration  planning  1  1   

•  Capacity  planning  1  1   

•  Environmental  planning  1  1   

•  Cabling  1  1   

•  Software  evaluation  1  1   

•  Consultancy  1  1   

•  Network  planning  1  1   

•  Network  management  1  1   

•  Disaster  recovery  1  1   

•  Facilities  management  1  1   

•  Problems  management  1  1   

•  Applications  software  support     1  1   

These  last  questions  complete  the  questionnaire.  I  would  like  to  thank  you  on  behalf  of  INPUT  for 
helping  us  to  complete  this  survey.  To  express  our  appreciation  for  your  time  we  will  be  sending  you 
a  "thank  you"  package  containing  a  summary  of  the  results  from  our  survey. 

Again,  thank  you  for  your  time. 
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In-depth  User  Questionnaire 


1.        What  do  you  consider  to  be  the  major  contentions  or  issues  related  to  the  service  you  receive 
on  your  computer  system? 

Hardware  Service 


System  Software  Support 


2.        What  do  you  consider  to  be  the  major  strengths  and  weaknesses  of  your  service  vendor? 
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3.       Has  the  level  of  service  you  receive  improved  or  degraded  over,  say,  the  last  three  years? 


4.       What  are  your  comments  related  to  your  service  vendor's  capability  in  the  following  aspects 
of  service  performance? 

A.  Hardware  Service 

Spares  Availability 


Engineer  Skills 


Problem  Escalation 


Documentation 
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Remote  Diagnostics 


B.  Systems  Software  Support 
Engineer  Skills 


Documentation 


Software  Installation 


Provision  of  Systems  Software  Updates 


Remote  Diagnostics 
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Do  you  feel  that  your  service  vendor  provides  the  quality  of  service  you  require?  What 
comments  would  you  make  related  to  quality  of  service  and  the  responsiveness  of  your  service 
vendor  to  your  specific  needs? 


How  would  you  prefer  your  service  vendor's  approach  to  providing  a  wider  range  of  services 
(other  than  maintenance  systems  software  support)  to  be  developed,  and  would  you  welcome 
the  availability  of  a  wider  range  of  services? 
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